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(57) ABSTRACT 

A novel data structure in a router helps to compute viable 
next hops for forwarding a data packet from a router to its 
destination along multiple alternate loop-free paths, which 
are not necessarily of shortest distance. Each viable next hop 
may also be specified with a degree of optimality, which 
enables a route to perform QoS routing and fault-tolerant 
routing efficiently. The data structure can be implemented as 
an add-on software to existing routing protocols and may be 
implemented in existing networks which use shortest path 
protocols, even where less than all of the routers use the data 
structure and multiple path scheme described herein. 

6 Claims, 3 Drawing Sheets 
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MULTIPLE PATH ROUTING SUMMARY OF THE INVENTION 

RELATED APPLICATIONS The present invention uses a multiple path algorithm 

rr^. „ - (referred to herein as "MPA") to enable a router to forward 

Hiis application claims the benefit of pro™ ^^^^^ ^^j,; ^^^1^ ^ 

patent application Ser. No. 60/056.028 filed Sep. 2. 1997. ^ ^^^^ ^ shortest path from the router to 

FIELD OF THE INVENTION packet's destination. The method of the present inven- 
tion still guarantees, however, that all packets will be routed 

The present mvention relates generally to routing data to their destination on loop-free paths. In general each path 
packets to a desimation node withm a packet switching traversing a different next hop is guaranteed to be loop free 

network. In particular the mvention relate to a multiple path if jt satisfies the constraint that the shortest distance from the 

routmg scheme usmg a novel data structure. implementing router to the destination decreases at each 

BACKGROUND OF THE INVENTION 

. , . , In a pre fened embodiment of the invention, the MEA uses 

In packet switching networks such as the Internet, a , ^^^^^ j.ta structure which stores information relating to 

packet from a source traverses intermediate network routers ^ach router (node) in the network that is a potential desti- 

before reaching its destination. Before a packet arrives at a „„de. In particular, the data structure maintains at 

router, a routmg protocol is u^d to determine the existence i,,^, following attributes: the shortest distance from the 

and statt^of all routers and links therebetween on the implementing router to the destination node; the cost of each 

network. -nils mformation is used by the router to delermme 1;^^ f.^^ j^e implementing router to each potential next 

an appropriate next hop for an arnving packet with a given hop; and for each potential next hop. the shortest distance 

destination. The next hop includes the next router along the fr^m the implementing router to the destination node along 

path to the destination and the outgomg port of the present ^ th traversing that particular next hop. 
router hnkug the next router. A widely used hnk-state 

routing protocol, is Open Shortest Path First ("OSPF") Usmg this da a structure, multiple viable next hops are 
_,. .1- , . • L 1 / J J 25 computed by selecting next hops from the potential next 

Given the current hnk states the network, (e.g. reduced ^ops whose shortest distance attribute traversing that next 

bandwidth increased bandwidth disconnected. j^op. minus the cost of the link from the implementing router 

reconnected) each router s keeps track of a shortest path tre^ to the next hop, is less than the shortest path from the 

SFl from S to every other router m the network. Smce the ; 1..*^ ,u ^ *• *• j 

implementmg router to the destmation node, 

router retams only one shortest path from S for each desti- L, . , 

nation router, the first hop from S along this path will be used "l^^^^.^^ structure of the present invention 

as the next hop to forward anv packets with the same given '^^^ ^.^ efficiently implemented as an add-on component to 

destination. " existmg routmg protocols such as OSPF. Each MPA imple- 

A iti,^,.„u „ • r\onr- u i u i • r *• menting router uses the topology information exchanged by 

Although a router usmg OSPF has global mformation „ , , / i .u u * 

u , ,u ' 1 * 1* 1 -.J* • 1 .1- the router protocols to compute multiple paths between a 

about the regional network topology, It determmes only the 35 ^•„^„ „„,!L _j / 

1 , , % , , . : u ^in. L . g^v®" source and a given destination. Moreover, conven- 

local route of a packet. I.e., the next hop. When each router w^^.i ™.*^«, k« ^ u ♦ ♦ *u *• 

i u *u p *• OFTT^ 1. tional routers based on shortest path routing can co-exist in 

computes such next-hop mformation based on an SPT, each ™ « 1 -.u x^nA • 1 • 

1,. ♦J4ir , r .t- the same network with MPA implementmg routers to guar- 

packet IS guaranteed to be forwarded along a loop-free path ^ * c u 1 * i ^ xiw^a 

f , f. A 1 f .u • iT * J > antee loop-free routmg for each packet. In general, an MPA 

to Its destination. A loop -free path is a path that doesn t • , , . , ^ , * 

. , . , XM t OTVT- implementmg router can interoperate with any router whose 

mclude the same router more than once. Multiple SPTs 40 #1 ,u i c i- 

, , , , c- • . • . 1 T i_ routing protocol uses the loop-free pohcy. 

rooted at router S can co-exist m a network. In such a case f f j 

there are multiple choices of next hops from S to forward a maintaining multiple viable next hops in a router for 

packet, each of which will lead to a different path of the ^^^^ destmation, recovery from Imk failure is much faster 

same shortest distance. The packet can be forwarded to any ^^^^ heretofore possible, smce the recovery mechanism 

of these next hops 45 alternate paths can be implemented locally by the 

Routing protocols allowing for only a single shortest path ^°!J^''' nM^^'^i!^ \^°f' "^.'^'^'Loa'"'?'^ 

suffer from several inefficiencies. For example, if immedi- '^^J^* hand, without MPA, after detectmg a 

ately before dispatching a packet along its next hop, a muter ^'^^^^^ the router would need to broadcast throughout 

leams that a link along the path is down, the router must first °'*7'*^ recompute the shortest path 

recompute a new single shortest path and only then send ±e 50 ^etermme a new alternative path, 

packet along the new next hop. gj^,^ DESCRIPllON OF THE DRAWINGS 

Ine smgle shortest path method also ignores network load 

considerations. Thus, even if a path has a lot of traffic the FIG. 1 is a graphical depiction of the data structure used 

packet will be forwarded along that path if it is the shortest in accordance with the present invention, 
to its destination. Furthermore, it is known that finding an 55 FIG. 2 is a graphical depiction of the data structure used 

optimal path that satisfies certain QoS constraints is in in a conventional shortest path tree algorithm, 

general computationally difficult (NP-complete). Since fIG. 3 depicts a router architecture employing the MPA 

some QoS parameters that need to be optimized may depend ,1 jthm as used in accordance with the present invention, 

on the network traffic load and thus can chance dynamically t-»^ ^ • . ^ 

over a short period of time, finding an optimal path can 60 . '* " ^presentation of a network of routers includ- 

become infeasible even for a moderate-size network. Even a source router S and a desUnation router D. 

for QoS parameters that do not change frequently, deter- DETAILED DESCRIPTION OF THE 

mining the optimal path from a router may require global INVENTION 
knowledge of these parameters in the network, and a local 

change in these parameters would therefore need to be 65 The packet routing method of the present invention 

disseminated to every node in the network. Hence in most involves making available at each router, alternative mul- 

cases only suboptimal paths can be computed. tiple next hops to forward a received packet. The only 
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constraint in computing the multiple next hops is that the ring significant computational complexity. More 

paths to the packet's destination resulting from these next specifically, a given router S will maintain for each desti- 

hops do not return the packet to any router it previously hit. nation node X the shortest distance d(S, X) from the router 

In other words, the paths of these alternative next hops S to X. This information can be computed with existing SPT 

should be loop free. As discussed above, the OSPF protocol 5 algorithms such as those taught in Dijkstra and Bellman, 

well known in the art, guarantees loop-free routing to each supra. In addition, the distance, or cost w(S,p) for each 

destination by constraining each router to choose the next outgoing link connecting the router S to a potential next hop 

hop b^ed on an SPT. However, a loop free path can be ^ maintained. Furthermore, the data structure keeps 

guaranteed even d it does not represent the shortest distance ^^^^^ ^^^^^^^ ^^^^ ^^^^ J 

to a destinahon. For example, any path to a destmation that ^„ , r c ?• u • j . j u j /o v\ »#t^a 

traverses a particular next hop from a router S is loop free ^' ^^'ch 'S denoted by d/S X). When the MPA 

if the distance to the destination continues to decrease at execution terminates, d (S, X) should equa the sum of 

each next hop w(S,P) and the shortest distance found, d(p, X) from p to X. 

In one preferred embodiment of the present invention mainUining this data structure, the MPAidentifies viable 

viable next hops from a router S. i.e., next hops which lie on ^""^ desUnat.on X using the pnnciples disci^ed 

a loop free path to a destination, can be guaranteed where the " xWs''^<d'fS "jo "'"^ ^ " 

shortest distance from S to the destination traversing a given ^ ' ^^"^ ^ ' ^' 

next hop, minus the cost of the Unk (i.e., its distance) from "^^^^^ hops satisfying the above inequality are 

S to that next hop is less than the absolute shortest distance liable and can be revealed by the MPA, it is possible for 

from S to the destination. For example, if router R is the next additional viable next hops to exist which will not be 

hop from router S along a shortest path from S to destination ^° revealed. By searching through paths, the data structure at 

router D, then the distance between R and D, i.e., d(R, D), ^^^^ ^^^^ updated, increasing the number of viable 

must be less than the distance from S to D, i.e., d(S, D). ^^^^ ^OP^- As long as the shortest distance to every node is 

Extrapolating R to any next router R,., which can even be a computed correctly, the resulting viable next hops will not 

router not on the absolute shortest path between S and D, a ^^^^ ^ ^^P- 

loop free path from S to D is guaranteed with a next hop to With the alternative viable paths for a given destination, 

R, if d(R;, D)<d(S, D). alternate paths can be constructed by comparing the MPA 

Referring to FIG. 4 an example of a neUvork of routers is ^^^^ structures associated with different destinations. Most 

showu, including source router S, destination router D and SPT algorithms known in the art constantly compare the 

a plurality of routers R. Each link between the routers is 3^ distance attributes of two neighboring nodes. The distance 

numbered and it is assumed that each link has the same cost, attribute of a node eventually converges to the shortest 

or distance. In this example, it is clear that there are three distance from the source to that node. The distance attribute 

shortest paths: (i) 1-2-3; (ii) 7-9-10; and (iii) 4-14-3. of node X from source S computed by the SPT algorithm is 

However, in addition to these shortest paths, there are at contained in the corresponding field 210 of the shortest 

least twenty four loop free paths. In particular, 1-5-6-14-3; 35 distance from S to X and is updated by the SPT algorithm, 

1-5-6-15-16-3; 1-5-6-15-12-13; 1-5-6-8-9-10; 1-5-6-8-9-11- independently of other operations of the MPA. 

16-3; 1-5-6-8-9-11-12-13; 4-5-2-3; 4-6-15-16-3; 4-6-15-12- Referring to FIG. 3, the extended routing algorithm 300 in 

13; 4-6-15-11-10; 4-6-8-9-10; 4-6-8-9-11-16-3; 4-6-8-9-11- accordance with the present invention comprises these mod- 

12-13; 7-9-11-16-3; 7-9-11-12-13; 7-8-15-16-3; 7-8-15-11- ules: MPA Algorithm 301, Conventional Routing Algorithm 

10; 7-8-15-12-13; 7-8-6-14-3; 7-8-6-14-16-12-13; 7-8-6-14- ^ 302 and Routing Protocol Memory 303. The MPA and 

16-11-10; 7-8-6-5-2-3; 7-8-6-5-2-16-11-10; 7-8-6-5-2-16- Conventional Algorithms 301 and 302, respectively, while 

12-13. A non-viable loop path, however, exists for example possible to be implemented with hardware, typically com- 

on path 7-8-6-5-2-16-15 . . . since link 15 will return the prise software executed on a standard microprocessor hav- 

packet to a router previously visited between links 8 and 6. ing the computing power of at least a Power PC or Pentium 

In the preferred embodiment of the invention, the MPA of 45 grade chip. Routing Protocol Memory 303 typically com- 

the present invention makes use of the data structure of FIG. P^ses at least 4 megabytes ("MB") of RAM, with 3 MB 

1 to compute alternate viable next hops from a router whose typically allocated to the Conventional Algorithm 302 and 1 

shortest distances to the destination are less than the shortest allocated to the MPA Algorithm. Furthermore, it is 

distance from the router to the destination. possible to provide physically separate RAM chips for use 

During execution, a conventional SPT algorithm usuaUy 50 ^^^^ algorithms 301 and 302. Forwarding Table 

keeps track of certain state information about each node in typically comprises at least 4 MB of RAM. 

the network. See E. Dijkstra, "A Note to Two Problems in Every time the SPT algorithm, represented by block 302, 

Connection with Graphs" Numerical Mathematics, vol. 1 p. makes a comparison between nodes a and b, the distance 

115-126 (1959); R. BeUman, "On a Routing Problem" attribute from source S to b, d^^b), is equal to the smaller 

Quarterly of Applied Mathematics, vol. 16, p. 87-90 (1958), 55 values between its old value and the sum of d^^(a)+w(a, b). 

hereby incorporated by reference as if fully set forth herein. Furthermore, with each comparison by the SPT algorithm 

Typically, such information consists of a distance attribute 302 between nodes a and b, MPA block 301 is triggered and 

210, the next hop attribute from the router 220, and perhaps starts its own comparisons. For every next hop p from S, the 

a parent attribute for each node 230, as shown in FIG. 2. At distance from S to b is set to the minimum of its old value 

each hop, during the execution of the SPT algorithm in 60 and d^(S, a)+w(a, b). With the termination of the SPT 

router S, the distance attribute 210 of destination node X algorithm, the MPA also terminates and the data structure is 

represents the distance of the shortest path found so far from updated in routing protocol memory 303. 

the router S to node X, while the next hop attribute and the With the availability of viable next hops the router can 

parent attribute respectively identify the first hop from router select the actual next hop for forwarding a packet based on 

S and the last hop to router S. 65 a variety of criteria such as round robin, network load, or 

ThedatastructureofFIG.l, however, contains more state shortest distance. Those skilled in the art will be able to 

information about each node in the network, without incur- devise various selection criteria. 
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Indeed, one such criteria can be used to determine satis- 
factory approximate solutions to QoS routing by decoupling 
the underlying optimization problem discussed above, into 
local and global computations. First, multiple viable paths 
that satisfy the global or less frequently changed QoS 5 
constraints are computed. Then among these viable paths, 
one that is optimized with respect to the local or more 
frequently changed QoS parameters can be determined. 

With respect to load balancing it should be noted that 
implementation of such a scheme may require a means to ^0 
preserve the FIFO arrival of packets where FIFO is assumed 
by the upper layer protocol at the destination router. It may 
also be necessary to provide additional buffer means and 
processing capabilities at the destination router, especially 
where FIFO is not strictly adhered to. 15 

In addition each router can compute and store in a 
forwarding table such as 350 in FIG. 3, each viable next hop 
for a given destination or maintain only a single viable next 
hop in forwarding table 350 while maintaining additional 
next hop infomiation in the routing protocol memory 303. 

By maintaining multiple viable next hops in a router for 
each destination, recovery from link failure is much faster 
than heretofore possible, since the recovery mechanism 
using alternate paths can be implemented locally by the ^5 
router, and there is almost no delay incurred by the link 
failure. On the other hand, without MPA, after detecting a 
link failure, the router would need to broadcast throughout 
the network the link failure, then recompute the shortest path 
tree to determine a new alternative path. 

A more exhaustive search of alternate next hops can be 
obtained by running a set of independent SPT algorithms in 
parallel. For every next hop p, any SPT algorithm including 
a dynamic algorithm, i.e., an algorithm which can compute 
a new SPT by readjusting the old SPT, is executed using 35 
only the distance attribute d^(S,X) in the data structure 
associated with the destination X. (While a static algorithm 
recomputes an entire shortest path, a dynamic algorithm 
recognizes that the majority of the path segments will 
remain the same and therefore only certain segments are 40 
recomputed). After the SPT algorithm is executed, the data 
structure is updated and all of the next hops p,- that satisfy the 
above inequahty are obtained. 

The foregoing merely illustrates the principles of the 
present invention. Those skilled in the art will be able to 45 
devise various modifications, which although not explicitly 
described or shown herein, embody the principles of the 
invention and are thus within its spirit. 

What is claimed is: 

1. A method for routing a data packet from an implement- 50 
ing router to a destination node in a packet switching 
network, said data packet originally from a source node in 
said packet switching network, said method comprising the 
steps of: 

A. determining and storing in a data structure: the shortest 55 
distance from the implementing router to the destina- 
tion node, the cost of each link from the implementing 
router to each potential next hop; for each of said 
potential next hop, the shortest distance from the imple- 



menting router to the destination node along a path 
traversing that particular next hop; 

B. storing said data structure in a first memory means at 
said implementing router; 

C. using said data structure to compute multiple viable 
next hops from the implementing router, each of said 
viable next hops lying on a path from said source to 
said destination node, by selecting next hops from the 
potential next hops whose shortest distance attribute 
traversing that next hop minus the cost of the link form 
the implementing router to the next stop is less than the 
shortest path from the implementing router to the 
destination node; . 

D. selecting the optimal of said one or more viable next 
hops to forward said data packet; 

E. upon the failure of forwarding said data packet via the 
selected next hop, removing the selected next hop from 
list of viable next hops and repeating step D until the 
data packet is successfully forwarded to next hop. 

2. A method according to claim 1 wherein each of said 
viable next hops are in a path from said destination whose 
shortest distance is less than the absolute shortest distance 
from said source node to said destination node. 

3. A method according to claim 1 wherein each of said 
viable next hops leads to a loop free path from said source 
node to said destination node, but is not constrained to lead 
to a shortest path between said source node and said desti- 
nation node. 

4. A method according to claim 1 wherein said selecting 
steps are constrained to select a viable next hop leading to 
the shortest path as compared with all of said one or more 
viable next hops stored in said first memory means. 

5. A method for determining muhiple loop free paths from 
a source node to a destination node in a packet switching 
network, said packet switching network comprising a plu- 
rahty of routers, said method comprising the step of select- 
ing at each of said routers next hops from potential next hops 
whose shortest distance attribute traversing that next hop, 
minus the cost of the link from the source node to the next 
hop, is less than the shortest path from the source node to the 
destination node. 

6. A router for use in a packet switching network for 
routing a data packet originating from a source node, to a 
destination node, comprising: 

storage means for a data structure, said date structure 
comprising; the shortest distance from said router to a 
destination node, the distance to each next hop from 
said router; and for each of said next hops, the distance 
of the shortest path from said router to said destination 
node using said next hop; and 

computer implemented means for determining one or 
more viable next hops from said data structure, by 
selecting next hops from potential next hops whose 
shortest distance attribute traversing that next hop 
minus the cost of the link form the implementing router 
to the next stop is less than the shortest path from the 
implementing router to the destination node. 
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